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Introduction: The 1989 workshop report entitled 
Workshop on Production and Uses of Simulated Lunar 
Materials [1] and the Lunar Regolith Simulant Materi- 
als: Recommendations for Standardization , Produc- 
tion, and Usage , NASA Technical Publication [2] both 
identified and reinforced a need for a set of standards 
and requirements for the production and usage of the 
Lunar simulant materials. As NASA prepares to return 
to the Moon, and set out to Mars a set of early re- 
quirements [3] have been developed for simulant mate- 
rials and the initial methods to produce and measure 
those simulants have been defined. Addressed in the 
requirements document are: 1) a method for evaluating 
the quality of any simulant of a regolith, 2) the mini- 
mum characteristics for simulants of Lunar regolith, 
and 3) a method to produce simulants needed for 
NASA’s Exploration mission. As an extension of the 
requirements document a method to evaluate new and 
current simulants has been rigorously defined through 
the mathematics of Figures of Merit (FoM). 

A single FoM is conceptually an algorithm defin- 
ing a single characteristic of a simulant [4] and pro- 
vides a clear comparison of that characteristic for both 
the simulant and a reference material. Included as an 
intrinsic part of the algorithm is a minimum acceptable 
performance for the characteristic of interest. The algo- 
rithms for the FoM are also explicitly keyed to a rec- 
ommended method to make the simulants. 

Benefits for this approach; 1) permit multiple ma- 
terials to be used as standards or reference; 2) allow 
multiple simulants to be compared in a standardized 
manner; 3) allows simulants to be standardized to a 
definition based on measurement protocols and not 
restricted to a physical reference material; 4) new 
batches of simulants or multiple providers of simulants 
can be readily compared, and 5) simulant requirements 
are permitted to evolve as knowledge or needs change. 

Intended Users of the FoM: The scientific and 
engineering communities are the primary two intended 
users of simulant materials and the data prpvided by 
the Figures of Merit. 

Utilization of the simulant by the science commu- 
nity will be in small quantities (kilograms vs. metric 
tons in most cases) in a laboratory or specialized pilot 
facility with the intent of developing or improving a 


process (e.g, oxygen or metals extraction) and may 
only require discrete amounts of simulant. Expectations 
are that the FoMs for these simulants will have higher 
values and tighter tolerances banding together to re- 
quire more closely controlled simulant production 
techniques. This in turn reflects on the additional qual- 
ity control aspects of how the simulant materials were 
collected, processed, and blended. 

Potential simulant providers may use offsite ana- 
lytical techniques to verify the simulant to the FoMs 
applied. “Offsite” implies that statistically relevant 
samples have been taken from the simulant components 
individually and the simulant after mixing, and ana- 
lyzed in a laboratory setting to verify the quality of the 
product. Tighter production tolerances or secondary 
processing are expected to drive higher dollar/kg costs 
to the end user. 

Utilization of the simulant by the engineering 
community will be in larger quantities (metric tons) 
necessary to develop large-scale processes for Lunar or 
Martian production facilities and construction. Exam- 
ples of engineering uses include developing drills and 
excavation equipment along with handling and hauling 
mass quantities of regolith. Processes developed for 
Lunar or Martian industrial applications must be robust 
enough to handle small amounts of contamination in- 
herent in the processing of large quantities of rocks and 
minerals on Earth. Many of these contaminants will be 
introduced during Lunar or Martian processing as well. 
Expectations are that the FoMs for these simulants will 
have lower values for some characteristics based on 
their intended end use. Potential vendors may use insite 
analytical techniques to verify quality of the simulant 
during production. “Insite” implies that a continuous 
sampling and analysis is occurring during the produc- 
tion run. Common methods of measurement utilized in 
continuous industrial processing are laser diffraction 
and automated vision systems. Automated analytic 
techniques coupled with large quantity production are 
expected to reduce the dollar/kg costs to the end user. 

Establishing Requirements Through the Fig- 
ures of Merit: Based on the work published in the 
Lunar Regolith Simulant Materials: Recommendations 
for Standardization , Production , and Usage , NASA 
Technical Publication [2], four key characteristics of 
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the Lunar regolith have been initially selected for the 
Simulant Requirements Document. Those characteris- 
tics are; composition, size, shape and density. As 
needs change new requirements and FoMs may be 
added, deleted or modified. To demonstrate the link 
between a Figure of Merit and requirements, the FoM 
of “composition” is used as an example. 

The Figure of Merit termed “composition” defines 
the geologic constituents of the simulant without refer- 
ence to textural features, such as particle shape and 
particle size. Composition includes the following 
classes of constituents: lithic fragments, mineral grains, 
glasses and agglutinates. Conceptually, composition 
addresses the chemical makeup of individual particles. 
The Simulant Requirements Document specifies the 
rock types, their chemical make up and which materials 
may or may not be used to establish a simulant requir- 
ing this type of Figure of Merit. 

Establishing a Reference Material: In normal 
use a reference material would be defined as a regolith 
core sample returned by an Apollo mission. However, 
any material real or predicted may be used, including 
another simulant. The reference material is measured 
and assigned values of 1 for all properties to be de- 
scribed by the Figures of Merit. The simulant is meas- 
ured for the same properties as the referenced material 
and the differences are evaluated according to the algo- 
rithms of the FoMs selected for comparison. 

The usefulness of allowing a predicted material to 
be the reference is that as mission planners evaluate 
and select potential Lunar sites for exploration/existing 
and new simulants may be evaluated for potential ana- 
logs for those sites through the Figures of Merit. If 
simulants must be produced, manufacturers of such 
materials now have a way to measure their product and 
select the “best fit” of raw materials and processing 
techniques. 

Conclusions: Requirements and techniques have 
been developed that allow the simulant provider to 
compare their product to a standard reference material 
through Figures of Merit. Standard reference material 
may be physical material such as the Apollo core sam- 
ples or material properties predicted for any landing 
site. The simulant provider is not restricted to provid- 
ing a single “high fidelity” simulant, which may be 
costly to produce. The provider can now develop 
“lower fidelity” simulants for engineering applications 
such as drilling and mobility applications. 
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Agenda 


• A quick review of Figures-of-Merit. 

- Composition 

- Size distribution 

- Shape 

- Density 

• Software Implementation of FoM Algorithms. 

- Components of the software 

- Inputs to the software 

• Demonstration of the software. 

• Backup slides. 
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A Quick Review of 
Figures-of-Merit 
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Characterization of Simulant Materials 


• A method is needed to specify simulant requirements and 
simulant suitability for a given purpose and to compare different 
simulants and simulants to reference materials. 

• D. Rickman has postulated that a simulant may be 
characterized by the following four quantities: 

- material composition 

- particle size distribution 

Hfe* * ' ' • 

- particle shape 

- material density 

• This leads to the search for methods of specifying and 
comparing materials in terms of these four quantities. 
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Figures of Merit (FoM) 


• A FoM is conceptually an algorithm for quantifying a single 
characteristic of a simulant and provides a clear measure of how 
well a simulant and reference material compare. 

• The human mind can only compare and rank scalars. Thus to 
compare more complex quantities, a method (algorithm) must 
be devised which boils the complex quantity down to a scalar. 

• In our context a FoM is a measure of how well a characteristic of 
a simulant material compares to a reference material. 

• For simulant specification and comparison, there are four FoMs, 
for the quantities composition, size, shape and density. 
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Composition 


• Composition defines the geologic constituents of a simulant 
without reference to textural features, such as particle shape 
and particle size. 

• Composition includes the following classes of constituents: 

- lithic fragments 

- mineral grains 

- glasses 

- Agglutinates 

• Conceptually, composition addresses the chemical makeup of 
individual particles. 

• Composition may be a function of the size of the particles. 
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Size Distribution 


Size distribution refers to the distribution of particle sizes. 
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Shape 


• Measures for Shape are still under development but may 
include: 

- Mean Width 

- Mean Shape Factor 

- Mean Aspect Ratio 

- Convexity 

• A Figure of Merit for shape is still under development and may 
influence how shape is defined and measured. 
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Density 


• Density refers to the average weight per unit volume of a 
material. 


V 
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Figures of Merit Usage 


• The FoMs have been constructed to lie in the range 0 to 1 with 0 
indicating a poor or no match and 1 indicating a perfect match. 

• The FoM may be used for specification by stating the value a 
simulant’s FoM must attain in order to be suitable for a given 
application. 

- as an example, for composition, an FoM of .75 might be quite 
suitable for road building experiments, while an FoM of .98 might 
be required for chemistry experiments 

• The FoM methodology may be used to compare various 
simulants from different vendors, production runs, and different 
kinds of simulant. 

• The FoM of a simulant may be used during production for 
quality control. 
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Algorithms for the FoMs - 
Some Preliminaries 


Reference Material 

• Reference material refers to the desired composition, size, 
shape or density of a material. 

• The composition, size, shape or density of a reference material 
usually mirrors that of an actual material but does not have to. 

- a reference material may be completely hypothetical 

• As such a reference material may be used for specification of a 
simulant. 

• A simulated material may also be compared to the reference 
material. 

- the simulated material should match to the degree specified, the 
reference material 
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Composition 


• The composition of a material (reference or simulant) is defined as a 
vector of the fraction of the various constituents of the material. 


• Composition may be defined at multiple levels of granularity, starting 
with the composition in terms of the four basic classes of 
constituents, lithic fragments, minerals, glasses and agglutinates. 

- each class may be sub-divided into sub-constituents as necessary for a 
particular application 

- this process may be repeated for multiple levels, but the level of detail 
need not be uniform across the various classes and sub-constituents or 
between two materials 

- the elements of a composition vector must necessarily sum to unity (the 
sum of the fractional parts must equal the whole) excluding 
contaminants 

• Composition may also be defined as a function of size, so that a 
composition definition for a substance consists of a set of vectors for 
various different particulate sizes, one vector for each of the various 
particle sizes or range of particle sizes. 
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Composition FoM 


• The Figures of Merit is defined as the scaled LI norm of the difference 
of two composition vectors subtracted from unity. 

• Scaling (normalization) forces the norm of the difference of two 
composition vectors to lie between 0 and 1 , and subtraction from unity 
results in a figure of merit of 1 for a perfect match to 0 for no match at 
all (as opposed to the other way around). 


\FoM = 1- 

XV adjusted ( Cadjusted reference — Cadjusted simulant ^ ^ 

[max, (w^,^) max 2 (w U( , jW )] [ 



XV adjusted ■ 1 ^ Cadjusted reference f - — Cadjusted simulant • 

= 1- 

i 

max 1 ( W adjus,ed ) + max 2 ( w aJjusleJ ) 


||w||| denotes the L 1 norm of vector w 


maxj(w) is i^ 1 largest element of w 


• The LI norm of a vector is defined as the sum of the absolute values of 
the elements of the vector. 
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Composition FoM 

Composition vectors displayed as a bar chart (example) 



Reference and Simulant Composition 
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Agglutinate2 




Composition FoM 

Difference of composition vectors (example) 



Glass3 

Glass4 

Agglutinatel 

Agglutinate2 



Size Distribution FoM 


• The FoM for a given reference and simulant relative frequency 
distributions is defined as 1 minus the square root of the integral 
of the weighted difference of the RFDs squared divided by the 
sum of the weighted integrals of the squares of the individual 
RFDs. 



• The FoM is further subject to certain maximum error constraints: 
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Relative F 


Size Distribution FoM 

Histogram of relative frequency as a function of size 
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Density 


• Density refers to the average weight per unit volume of a 
material. 

• Density shall be measured by taking a sufficiently large enough 
sample so that the sample follows the particle size distribution of 
the material as defined in the slides on Size Distribution. 

- This avoids biasing the value of the density to the density of an 
aggregate of small particles which may pack more closely or an 
aggregate of large particles which may pack more loosely than an 
aggregate of particles which follows the particle size distribution as 
defined in the slides on Size Distribution. 
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Density FoM 


• The figure of merit for how closely a simulant matches a reference is 
proportional to the ratio of the densities. 


• Ratios of less than I - density 
quotient limit or greater than 1 
+ density quotient limit 

correspond to figures of merit 
of 0, while a ratio of 1 
corresponds to a figure of 
merit of 1 . 

• Mathematically and 
graphically this may be 
expressed as: 
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simulant density 


density limit - 1 


density quotient limit \ reference density ) density quotient limit 

„ t ^ simulant density 

for 1 - density quotient limit < < 1 

reference density i 


simulant density 


density limit + 1 


FoM = < density quotient limit ^ reference density ) density quotient limit 

„ , ^ simulant density ... ... 

for 1 < — < 1 -I- density quotient limit 

reference density 


0 otherwise 
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Software Implementation of 

FoM Algorithms 
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Components of the Software 


The software which implements the Figures-of-Merit consist 
three parts: 

- An input editor - we use Microsoft Excel for this purpose. 

- A back end that computes the Figures-of-Merit - we use 
The MathWorks Matlab for this purpose. 

- A front end with which the user interacts that opens and 
reads the Excel input files, performs checks on the inputs 
and calls the Matlab routines for computation of the 
FoMs - This is custom code. 
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What the FoM Software Is and Is Not 


• Given input data on the composition, size distribution, shape 
and density of two materials, the FoM software computes the 
Figures-of-Merit discussed in this presentation. 

• The software itself DOES NOT contain any data; it is not a 
database, only a computational engine. 
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Inputs - Composition 
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Inputs - Shape 
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Inputs - Density 
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FoM - Composition 
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FoM - Density 
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Regolith Properties To Be Simulated And Their 
Relationship to the Figures Of Merit 


Figures of 

~ Merit 

Simulant " 

Properties 

Composition 

Size 

Shape 

Density 






1. Grain Properties 

X 

X 

X 


2. Electrostatic Charging Properties 

X 

X 



3. Magnetic Properties 

X 

X 



4. Geomechanical 
Mechanical 





a. Fatigue 

X 

X 

X 

X 

b. Strength 





i. Tensile 

X 

X 

X 

X 

ii. Compressive 

X 

X 

X 

X 

iii. Shear 

X 

X 

X 

X 

iv. Grain Hardness 

X 




v. Coefficient of Friction 

X 

X 

X 

X 

c. Flexural Strength - Bending Resistance 

X 

X 

X 

X 

d. Fracture Properties 

X 

X 

X 

X 

e. Impact Resistance 

X 

X 

X 

X 

f. Rheology (flow properties) 

X 

X 

X 

X 

g. Angle of Repose 


X 

X 

X 
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Regolith Properties To Be Simulated And Their 
Relationship to the Figures Of Merit 


Figures of 

- — Merit 

Simulant 

Properties 

Composition 

Size 

Shape 

Density 






4. Geomechanical (cont’d) 
Physical 





h. Thermal Properties 

X 

X 

X 

X 

i. Bulk Density 

X 

X 

X 


j. Particle Density 

X 




k. Porosity 

X 

X 

X 

X 

1. Surface Area 

X 

X 

X 


m. Permeability (gas) 

X 

X 

X 

X 

5. Agglutinate-specific 





a. Friability 





b. With single-domain iron 





6. Chemical Reactivity 





a. From surface damage 





b. As volatile / soluble minerals 





7. Chemical Properties 





a. Bulk 

X 

X 

X 

X 

b. Mineral 

X 

X 

X 
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Regolith Properties To Be Simulated And Their 
Relationship to the Figures Of Merit 


Figures of 

— Merit 

Simulant 

Properties ~~~ _ 

Composition 

Size 

Shape 

Density 






7. Chemical Properties (cont’d) 





c. Glass 

X 

X 

X 


8. Modal Composition 





a. Total 

X 




b. As a function of grain size 


X 



9. Texture 

X 

X 

X 


10. Implanted solar particle-specific (e.g. H, C, 

N) 

X 





National Aeronautics and Space Administration 


Page 34 





